Hybrid Bat & Levenberg-Marquardt Algorithms for Artificial Neural Networks Learning

The Levenberg-Marquardt (LM) gradient descent algorithm is used extensively for the training of Artificial Neural Networks (ANN) in the literature, despite its limitations, such as susceptibility to the local minima that undermine its robustness. In this paper, a bioinspired algorithm referring to the Bat algorithm was proposed for training the ANN, to deviate from the limitations of the LM. The proposed Bat algorithm-based LM (BALM) was simulated on 10 benchmark datasets. For evaluation of the proposed BALM, comparative simulation experiments were conducted. The experimental results indicated that the BALM was found to deviate from the limitations of the LM to advance the accuracy and convergence speed of the ANN. Also, the BALM performs better than the back-propagation algorithm, artificial bee colony trained back-propagation ANN, and artificial bee colony trained LM ANN. The results of this research provide an alternative ANN training algorithm that can be used by researchers and industries to solve complex real-world problems across numerous domains of applications.